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SECRET 


22 October 1968 


MEMORANDUM FOR: 
THROUGH : 
SUBJECT : 
REFERENCE : 


Deputy Director for Support 

Chief, Assessment and Evaluation Staff, OMS 

Periodic Progress Report 

Memo dated 2 6 July 1967 for DDS fr D/MS, subj : 
Proposed Systems Analysis of Psychological Data 


1 . During this reporting period, major emphasis was placed upon 
intensively analyzing relationships among PATB data, training outcomes, 
and rated job performance and potential for Career Trainees. An attach- 
ment summarizes these relationships. In addition, progress was made in a 
number of other areas: an attitude questionnaire was administered to 71 
DDP-bound CTs in training; the relationships between personality patterns 
measured by the California Psychological Inventory and job performance and 
potential were studied; comparisons were made on PATB intellectual measures y 
among groups of CTs who resigned and those who remained; and comparisons of 
test profiles of CTs and non-CTs were completed. 

2. A s umm ary status report for the CT Systems Study is attached. This 
table briefly describes completed, ongoing, and planned research of the study. 

3 . In order to portray graphically the relationships among PATB variables 
training performance and on-the-job performance, a number of expectancy tables 
were prepared; representative ones are attached to this memorandum. A word of 
caution about the meaning and possible application of these tables Is in order 
Expectancy tables can and often do change over time as people from different 
backgrounds are selected for new jobs. In addition, they should not be used 
alone in arriving at recommendations. Sound professional use of psychological 
tests requires psychologists to combine and integrate a variety of test and 
non-test information to arrive at meaningful recommendations. Thus, these 
expectancy tables are prepared primarily to illustrate some of the relation- \ 
ships of our test data to criterion data rather than as specific guides for 
selection and placement decisions. 

4. An overview of the major findings to date of the CT Systems Study is 
attached. More detailed reports have or will be prepared covering these topic 
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SUBJECT: Periodic Progress Report 


5 . We would like to mail to applicants at the time they are offered 
appointments to the CTP the questionnaire previously submitted to you on 
9 August 1968 (Subj : Attitudes of CTP Applicants), designed to measure 
attitudes relevant to their accepting or declining Agency employment. 

However, if you feel that such a procedure is not in the best interests of 
the Agency, we could administer the questionnaire to CTP applicants at the 
time of their headquarters visits. We ask your decision on which procedure 
to employ. 

6 . As before, Agency interest and cooperation in the CT Systems Analysis 
remains high. 


25X1 


Acting Chief, Research Branch 
Assessment and Evaluation Staff 
Office of Medical Services 

tcting Chairman, Task Force on Systems Analysis 
'f Psychological Data Pertaining to Career Trainees 


25X1 


Attachments : 

A. Summary status report of systems analysis of 

psychological data pertaining to Career 
Trainees 

B. Overview of major findings of CT Systems 

Study to date 

C. Significant relationships among PATB variables, 

Manpower Ratings of performance and potential, 
and training evaluations 

D. Expectancy Tables: Representative significant 

relationships among PATB test variables. 
Manpower Ratings of performance and potential, 
and training evaluations 

GMS / AES/ GYD :mak 
Distribution: 

Orig & 1 - Addressee, w/attachments 
1 - D/MS, w/attachments 

1 - Each member of Task Force, w/attachments 

2 - AES/OMS 
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ATTACHMENT A 


SUMMARY STATUS REPORT OF SYSTEMS ANALYSIS OF PSYCHOLOGICAL 
DATA PERTAINING TO CAREER TRAINEES 
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SUMMARY STATUS REPORT OF SYSTEMS ANALYSIS OP PSYCHOLOGICAL 
DATA PERTAINING TO CAREER TRAINEES 


BASIC OBJECTIVES OP STUDY: 
QUESTIONS ABOUT SELECTION AND 
MANAGEMENT PROCESSES 

• COMPLETED 

UNDERWAY 

PLANNED 

Who applies to the CTP? 


Description of test and 
background characteristics 
of CT applicant pool (report 
in preparation). 

Selected comparisons of 

CT applicants with applicants 
to analogous programs (FSO, FSEE) , 

Whom does the Agency hire 
as CTs? 

Comparison of Hires and 
Non-Hires on intellectual , 
temperament, and work, 
attitude variables (report 
completed). 

Development of questionnaire 
to tap factors relevant to 
applicants' decision to 
accept or decline appoint- 
ments to CTP 

Comparison of Hires and Non- 
Hires on vocational interest 
scales and background ex- 
periences. 

Study of relationships of 
psychiatric rating scale 
and OMS dispositional data 
with PATB and personnel 
variables . 

Comparison of CTs and Non- 
CTs on PATB variables 
(report in preparation). 

Selected comparisons of CTs 
with trainees in analogous 
programs (FSO, FSEE). 

Administration of questionnaire 
to tap factors relevant to 
applicant's decision to accept 
or decline appointments. 

Reasons for not hiring applicants 
will be sought on Non-EOD 
applicants; these reasons will 
be correlated with PATB. 

Comparison of external and 
internal CTs on PATB and 
selected personnel and admin- 
istrative variables (promotion 
rate, fitness reports, etc.). 

Who does well in training? i 

Relationships between PATB ! 

data and training evalua- 
tions for all CTs in 
Professional Manpower Study 
(draft completed). 

Relationships between PATB 
data and training evalua- 
tions for all CTs on whom 
both training and test data 
are available. 


Who works in DDI? DDP? DBS? 

Comparisons of CTs In. DDI, 

DDP, and DDS on vocational 
interest and work attitude 
variables (draft completed). 

Approved For Release 2003/047® 

Comparisons of CTs in DDI, 

DDP, and DDS on intellectual, 
temperament, and background 
information variables. 

re CIA-RDP84-00780R003700090006- 

Development of "index of 
assignment stability" to 
identify conecrmmltants of 

Job mobility within the Agency. 

) 
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Who stays with the Agency? 


Comparisons of "stays." 
"quick dropouts" and "slow 
dropouts" on Intellectual 
variables (draft completed). 


Comparisons of "stays," "quick 
dropouts" and "slow dropouts" on 
temperament, work attitudes, 
vocational interest, and back- 
ground variables. 


Who is satisfied with his 


Analysis of relationships between 
reason for resignation (reported 
at exit interviews) and prior 
test and personnel variables. 


job? 


Attitude survey of sample of 
DDP-bound CTs, 


Attitude surveys of DDF, DDI, 
and DDS CTs in training and 
on-the-job 


Analysis of relationships between 
attitudes, test performance, and 
job performance. 


Who performs well? And 
advances? 


* 

Ratings gathered by the Committee 
on Professional Manpower, a 
Committee established by the 
Executive Director to examine the 



Relationships between PATB 
intellectual, temperament, 
work attitudes, and voca- 
tional interest variables 
and Manpower Eatings" of job 
performance and potential 
(draft completed). 

Relationships between Calif- 
ornia Psychological Inventory 
variables and Manpower Ratings 
of job performance and poten- 
tial (report completed). 

Relationships between 
performance in CT training 
courses and Manpower Ratings 
of job performance and poten- 
tial (draft completed). 


Study of relationships 
between clinical interpreta- 
tion of PATB tests and job 
performance and potential. 

Study of relationships 
between comprehensive 
assessment data and job 
performance and potential. 

Analysis of relationships 
between military rank and 
job performance and potential. 

Analysis of relationships 
between educational level 
achieved and job performance 
and potential. 


Analysis of relationships between 
fitness report ratings, promo- 
tion rates, and PATB variables. 

Analysis of relationships between 
refined experimental ratings 
(supervisor, peer and subordinate 
ratings) and PATB variables. 


Relationships between college 
quality and mnpower Ratings 
of job performance and poten- 
tial (report completed). 
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ATTACHMENT B 

OVERVIEW OF MAJOR FINDINGS OF THE CT SYSTEMS STUDY TO DATE 
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22 October 1968 


OVERVIEW OF MAJOR FINDINGS OF THE CT SYSTEMS STUDY TO DATE 


Relationships "between Test Results and Job Performance and Potential 

1. All major portions of PATB show significant relationships with the 
performance and potential ratings gathered by the Committee on 
Professional Manpower (R=380 CTs). 

2. More and larger relationships emerged between PATB tests and job v 
performance and potential for a group of non-CT professionals (N=3bO) . 

The non-CT sample produced nearly double the number of significant 
relationships found for the CTs. In all likelihood, this difference 
is primarily due to restriction of the range of test scores in the 

CT sample — the CT sample was more homogeneous in intellectual 
ability, work attitudes, interests and temperament. 

3. The pattern of relationships which emerges is not complete -- no ,, 

PATB test is significant for all groups (DDI, DDP, and DDS CTs/ 
and not all tests are significant for any group. 

h. Rated job performance and potential of DDP CTs are harder to predict * 
than performance and potential of DDI or DDS CTs. 

5. Of the four major portions of PATB (excluding the Background Informa- 
tion Questionnaire which has not been thoroughly studied) — intellectual 
measures, temperament measures, work attitudes, and vocational interests 
vocational interests were most consistently and strongly related to rated 
job' "performance and potential. Intellectual measures were next., followed 
by work attitudes and temperament measures. 

6. The California Psychological Inventory, a relatively sophisticated 
personality inventory not included in the present Professional Applicant 
Test Battery, predicts job performance and potential of CTs significantly 
better than any other single group of tests currently in PATB. 

7. One of the major reasons why larger relationships did not emerge may 
be due to the ratings themselves. Within each of the directorates, a 
-wide range of jobs requiring many different types of skills is found. 

More refined studies are needed in which people doing similar jobs are j 
studied together, with more than one person making ratings for each 
individual. 
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Relationships between Test Results and Performance in CT Training Courses 

Bote: To date, all analyses involving training evaluation data have 
been limited to CTs on whom Manpower criterion ratings were available. 
Typically this has meant that less than one-half of the available 
training data in any course has been related to PATB; subsequent 
analyses will incorporate these additional data. 

1. The size and number of significant relationships found between PATB 
tests and training outcomes vary considerably from course to course. 
Perhaps the adjective "moderate 1 ' best describes and summarizes the 
magnitude of the test-training linkage. Comparatively speaking, more i 
and larger significant relationships were found in this linkage than j 
in the one between tests and rated job performance and potential. 

This may be due in small part to the shorter period of time that ' 

elapses between testing and training than between testing and obtaining 
job ratings; hence, there are fewer interpolated experiences and 
developments to impinge on the relationship and mask its true size. 

2. It appears that those courses taken by all CTs (Orientation, Communism, 
and Intelligence Techniques) are more predictable by our tests than 
those courses taken only by CTs entering a particular Directorate. 

The ITC and Communism courses are most strongly related to PATB with 
tests and scales from the intellectual, personality, work attitudes, 
and vocational interests areas all having significant relationships 
with these training courses. 

3. The significant relationships that emerged between PATB and training 
very often make good sense in terms of our understanding of what our 
tests measure and what we assume good performance in the specific 
training course might require. Thus, for example, performance in the 
Support Services Course, which deals extensively with matters of 
accounting, finance, and logistics, relates significantly to tests of 
arithmetic reasoning, computational skills, and having interests 
similar to accountants. The ITC, which puts a premium on verbal 
skills and interests, relates significantly to tests measuring 
vocabulary, reading comprehension, ability to interpret chart/graph 
data, and vocational interest scales concerned with writing. 

Relationships between Performance in CT Training Courses and Job 

Performance and Potential 

1, Relationships between overall training evaluations and the individual 
Manpower Ratings of job performance and potential are typically 
significant and of moderate size. Performance and potential seem / 
to be about equally predictable from training data. * 
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2. Performance in the Intelligence Techniques Course and the Operations 
Course appear particularly predictive of the Manpower job ratings — 
a median correlation of .2 6 was found and all correlations reached 
statistical significance. Training outcomes in the CT Communism 
Course and the Intelligence Production Course were next most highly 
related to the job ratings. Lepst predictive of job performance 

and potential was the Support Services Course for CTs — no significant 
relationships — followed by O.C., Phase II and the Clandestine Services 
Records II courses — each having one significant relationship. 

3. Although the moderate relations found between training and job ratings 
make good sense in that training often requires simulated job behavior, 
there remains the possibility that the job ratings of performance and 
potential are partly contaminated by the rater’s knowledge of the 
ratee’s training record — hence a self-fulfilling prophecy, 

IV. Comparison of CT Hires and Non- Hires 

1, On all measures of intellectual ability, the Hires were clearly j / 

superior in average performance to the non- Hires. ! 

2, Hires consistently express greater willingness to accept a wide 
variety of job requirements and/or restrictions than non- Hires; 
overall, the Hires appear more flexible. 

3, Differences in temperament scores between Hires and non-Hires were 
not significant. 

V. Comparisons of CTs in DDI, DDP, and DDS on Vocational Interests and 

Work Attitudes 

1. DDP trainees are more willing to work In jobs involving potential 
hazards, live in a socially deprived area, endure annoying work 
environments, be subjected to security restrictions, be physically 
active, and work at a changing, unpredictable pace than DDS or DDI 
trainees. DDI trainees are most reluctant toward these job demands, 
with DDS trainees falling between the DDP and DDS groups. 

2. DDI and DDP CTs tend to have interests dissimilar to people in 
business-sales and scientific occupations and Interests similar to 
people In verbal-persuasive occupations (law, journalism, etc). DDS 
CTs tend to have interests similar to people in business- sales 
occupations and dissimilar to people in verbal- persuasive and 
scientific areas. 
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VI. Comparisons of CTs and Non-CT Professionals on PATB Variables 


1. On the average, CTs score higher on all intellectual variables than 
non- CTs. 

2. On temperament measures, CTs appear more outgoing, socially assertive, 
and quick- working than non- CTs. 

3. On l4 of the 15 work attitudes, CTs are more eager and adaptable than 
non- CTs. 


4. CTs have interests more similar to people in the verbal persuasive 
and social service/managerial areas than non-CTs. Hon- CTs have 
stronger Interests in the scientific and outdoor technical areas 
than CTs. 



Comparisons of Intellectual Levels of CTs VJho Leave the Agency with 
Those Who Remain 


1. For the first 15 CT classes (July 1951 to September 1958), "quick 
dropouts" — those who left the Agency in less than one year — 
exceeded those who remained on seven of eight intellectual variables. 
A similar pattern was found for "slow dropouts" — those who stayed 
with the Agency five years before leaving -- who exceeded the stays 
on six of eight intellectual tests. 


2 . 



For the next 20 CT classes (September 1959 to February 1967), CT 
trainees who left the Agency in their first year did not score higher 
on intellectual measures than those who remained as career employees. 
However, CTs who left the Agency after being assigned to operating 
positions were superior to those who remained on all intellectual tests 


VIII. Military Service, Educational Level Attained, and Job Performance 
and Potential 


1. Ho relationship emerged between presence or absence of military 
service and rated job performance and potential of CTs. Similarly, 
rank attained in the service was unrelated to ratings of job performance 
and potential. 

2. Over 99 per cent of CTs in the Manpower Study had bachelors or masters 
degrees. Within this relatively narrow range of educational level, a 
small relationship was found between highest degree obtained and rated 
job performance and potential. Those CTs who had obtained. their masters 
degrees received, on the average, very slightly higher ratings Ox 
perfo rman ce and potential than CTs with only bachelors degrees. 
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IX. College Quality and Job Performance and Potential 

1. A relationship was found between the quality of the undergraduate 
colleges attended by CTs and their rated job p otenti al. Those CTs 
graduating from "high-quality" colleges ( not limited to Ivy League 
schools) received, on the average, higher ratings of job potential y 
than CTs from "lower-quality" schools. 

2. Comparable relationships between college quality and rated job 
performance emerged only for DDP CTs. 

X, Attitude Survey of CT Sample in Training 

1. Preliminary analyses of attitude data from 71 CTs in operations / 

training indicate that this group has good morale and a high degree 1/ 
of confidence in the management of the CT Program. Moreover, 81; to 

go $ of these CTs responded in the favorable direction to questions 
concerning staff-trainee interpersonal relationships. 

2. Less positive attitudes were expressed toward selected aspects of the 
traini ng experience. Thus, for example, sizeable minorities commented 
unfavorably on the degree of intellectual stimulation provided by the ,/ 
program (28$) and intimated that there should be more on-the-job and 
less formal training (L3$). By far, the area in which the most wide- 
spread concern was expressed involved provisions for feedback, evalua- 
tion, and especially job assignment. 

3. Although based on limited data, it appears that Internal CTs respond \ 
more favorably to the training program than Externals. A full report > 
of this study is in preparation and plans for additional administra- 
tions of the attitudinal questionnaire are being discussed with C/CTP. 
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ATTACHMENT C 

SIGNIFICANT RELATIONSHIPS AMONG PATB VARIABLES, MANPOWER RATINGS 
OF PERFORMANCE AND POTENTIAL, AND TRAINING EVALUATIONS 


(i) Significant Relationships "between PATB Variables and Manpower Ratings 
of Performance and Potential 

(il) Significant Relationships between PATB Variables and Overall Training 
Evaluations for Courses Taken by All Career Trainees 

(ill) Significant Relationships between PATB Variables and Overall Training 
Evaluations for Courses Designed for Specific Directorates 

(IV) Significant Relationships between Training Evaluations and Manpower 
Ratings of Performance and Potential 
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I 

SIGNIFICANT RELATIONSHIPS BETWEEN PATB 
VARIABLES AND MANPOWER RATINGS OF 
PERFORMANCE AND POTENTIAL 


Overall CTs 
(11=372-386 males) 


Intellectual Measures 


Performance Potential 


Ideational fluency 
Vocabulary 

Knowledge of current affairs 
Language aptitude 

Temperament Measures 

Self-confidence 

Work Attitudes: Eagerness 
to Accept (or deal with) 


Hazards 

Annoyances 

Social deprivation 

Unpredictably unstructured work 

Physically demanding work 

Strong Interest Scales : 

Interests Similar to 

Personnel Directors 
Public Administrators 
Senior CPAs 
Production Managers 
Accountants 
Army Officers 
Psychologists 
CPA Partners 
Dentists 

DDS Logistics Officers 
Bankers 

Real Estate Salesmen 



+ = statistically significant positive relationship 
- = statistically significant negative relationship 
no sign = no significant relationship 
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D PP CTs 
(N=205-217) 


Performance Potential 

Intellectual Measures 

Vocabulary + + 

Ideational fluency + + 


Temperament Measures 


Work Attitudes; Eagerness 
to Accept (or deal with) 

Hazards 


Strong Interest Scales : 
Interests Similar to 


Psychologists + + 

Senior CPAs + + 

Public Administrators + + 

Intelligence Officers + 

Bankers 

DDS Logistics Officers 
Real Estate Salesmen 
Life Insurance Salesmen 


+ = statistically significant positive relationship 
- = statistically- significant negative relationship 
no sign = no significant relationship 
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DPS CTb 

In?79-89) 


Intellectual Measures 


Performance Potential 


Ideational fluency 


Temp erament Measure s 
Self-confidence 


Work Attit u des : Eagern ess 
to Accept Tor deal with) 

Work involving analysis of others 
Work requiring mechanical skill 
Extensive supervisory responsibility 
Resourcefulness-demanding work 
Work offering little reward or recognition 
Unpredictable, unstructured work 


St rong Interest Scales : 
Interests Similar to 


Chemists 

Production Managers 
Accountants 
Purchasing Agents 
Army Officers 

Math, Physical Science Teachers 

Forest Service Personnel 

IMCA Directors 

Personnel Directors 

YMCA Secretaries 

Engineers 

Carpenters 

Public Administrators 
Senior CPAs 

Presidents, Manufacturing Concerns 

Lawyers 

Musicians 

Author- J ournalist s 
Artists 


+ 

+ 

4- 

+ 

+ 

+ 

+ 


4* 

+ 

+ 

+ 

+ 

+ 

4 - 

+ 

4 - 

+ 

+ 

+ 

+ 


+ = statistically significant positive relationship 
- = statistically significant negative relationship 
no sign = no significant relationship 
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„ D PI CTs 

(¥= 81 - 83 ) 


Performanc e Po tent l&l 

Intellect u al Measur es 

Ion- verbal reasoning 

Interpretation of chart/graph data + 


Temperament Measures 

Speed of actions 
Physical activity 


Work Attitudes : Eagerness 
to Accept (or deal with) 

Extensive training 
Security restrictions 
Resourcefulness-demanding work 
Work requiring mechanical skill 
Undesirable people 


Strong Interest Scale s : 
Interests Similar to 


CPA Partners 
Lawyers 

Real Estate Salesmen 
Life Insurance Salesmen 
Advertising Men 

Presidents, Manufacturing Concerns 

Author- J o urnali st s 

DDS Security Officers 

Dentists 

Farmers 

Forest Service Men 
Physicians 
Aviators 
Carpenters 

Math, Physical Science Teachers 

Policemen 

Army Officers 

YMCA Directors 


+ = statistically significant positive relationship 
- = statistically significant negative relationship 
no sign = no .significant relationship 
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II 

SIGNIFICANT RELATIONSHIPS BETWEEN PATB VARIABLES AND OVERALL 
TRAINING EVALUATIONS FOR COURSES TAKEN BY ALL CAREER TRAINEES 


CT CT Intelligence 

Orientation Communism Techniques 

(N=258) (N=333) (N=277 ) 

Int elle ctual Measure s 


Knowledge of current 
affairs 
Vocabulary 

Reading comprehension 
Arithmetic reasoning 
Interpretation of chart/ 
graph data 
Language aptitude 
Intellectual composite 

Temperament Measures 

Solitary 
Self-confidence 
Physical activity 

Work Att itu des; Eagerness 
to Accept (or' deal with j 

Physically demanding 
work 

Annoyances 

Hazards 

Social deprivation 
Security restrictions 
Undesirable people 
Work requiring mechanical 
skill 

Strom Interest Scales : 

Int ere sts Similar to 

Psychologists 
Architects 
Physicians 
City School 

Supe rint endent s 
Musicians 


+ + + 

+ + 

+ + 

-t" 

+ + 


+ 

+ 


+ 


+ 

+ 

+ 

+ 

+ 
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CT 

CT 

Intelligence 

Orientation 

Communism 

Techniques 


(N=258) 

(FM333) 

(U=277) 

cont ' d« 




Strong Interest Scales : 




Interests Similar to 




CPA Partners 

+ 

+ 


Advertising Men 



+ 

Lawyers 

+ 

+ 

+ 

Author- J oumalists 


+ 

+ 

Persons in Professional 



+ 

Occupations 




Dentists 

- 



Production Managers 


- 


Farmers 

- 

- 


Pilots 

- 



Carpenters 

- 

- 


Math- Physical Science 



- 

Teachers 




Policemen 



- 

YMCA Physical Directors 



- 

Office Men 


- 

- 

Purchasing Agents 


- 


Agency Logistics Officers 


- 

- 


OFC — insufficient data available at time of report — relationships will 
be reported later. 


+ = statistically significant positive relationship 
- = statistically significant negative relationship 
no sign = no significant relationship 
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III 

SIGNIFICANT RELATIONSHIPS BETWEEN PATB VARIABLES AND OVERALL TRAINING 
EVALUATIONS FOR COURSES DESIGNED FOR SPECIFIC DIRECTORATES 


Intelle ctual Measures 


Operations 

Course 

(N=232) 


Intelligence 

Production 

(N=90) 


Support 

Services 

Course 

(N=83) 


Operations 
Course II 
(N=117 ) 


Clandestine 
Services 
Records II 
(n=56) 


Non-verbal reasoning 
Reading comprehension 
Ideational fluency 
Knowledge of current 
affairs 

Interpretation of chart/ 
graph data 
Arithmetic reasoning 
Computational speed 
Intellectual composite 


+ 

+ 


+ 

+ 

+ 


+ 

+ 


Temperament Measures 

Outgoing 

Predominance 

Work Attitudes: Eagerness 
to Accep t (o r deal with) 

Hazards 

Work offering little 

reward or recognition 
Work requiring mechanical 
skill 

Resourcefulness-demanding 

work 

Work involving analysis 
of others 

Strong Interest Scales : 
Interests Similar to 

Psychologists 

Personnel Directors 

City School Superintendents 

CPA Partners 

Accountants 

Bankers 

Lawyers 

Intelligence Officers 

Architects 

Dentists 

Farmers 

Forestry Service Men 


+ 

4 * 


+ 

+ 


+ 
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cont 

Strong Interest Scales : 
Interests Similar to 


Operations 

Course 


(N- 232) 


Intelligence Support 
Production Services 

(N=90) Course 

(N=83) 


Operations 
Course II 


(W=117) 


Musicians 
Advertising Men 
Agency Logistics Officers 
Persons in Professional 
Occupations 


+ = statistically significant positive relationship 
- = statistically significant negative relationship 
no sign = no significant relationship 


Clandestine 
Services 
Records II 

(N-56) 


- 2 - 
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IV 


SIGNIFICANT RELATIONSHIPS 
AND MANPOWER RATINGS OF 

BETWEEN TRAINING EVALUATIONS 
PERFORMANCE AND POTENTIAL 


Course Title 

Performance Potential 

CT Orientation 
(N=258) 

+ 

+ 

CT Communism 

(N=333) 

-t- 

+ 

Intelligence Techniques 
(N=277 ) 

OFC* 

4* 

+ 

Operations Course 
(N=23l) 

+ 

+ 

Intelligence Production 
(N=90) 

+ 

+ 

Support Services 
(N=8s) 

Operations Course II 
(N=117) 

+ 

+ 

Clandestine Services 

Records II 
(N=56) 

+ 


*0FC — insufficient data available. 




+ = statistically significant positive relationship 
no sign = no significant relationship 
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' ATTACHMENT D 


EXPECTANCY TABLES: REPRESENTATIVE SIGNIFICANT RELATIONSHIPS AMONG 
PATB TEST VARIABLES, MANPOWER RATINGS OF PERFORMANCE AND 
POTENTIAL AND TRAINING EVALUATIONS 


(I) Representative Significant Relationships between PATB Test 
Variables and Performance/Potential Ratings 

(II) Representative Significant Relationships between PATB Test 
Variables and Overall Evaluations In CT Training Courses 

(III) Representative Significant Relationships between Overall 

Evaluations in Training Courses and Ratings of Job Perfor man ce 
and Potential 
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I 


REPRESENTATIVE SIGNIFICANT RELATIONSHIPS BETWEEN PATB TEST 
VARIABLES AND PERFORMANCE/ POTENTIAL RATINGS 
(From Manpower Study) 


TEST: 

MEASURES: 

GROUP: 

CORRELATION: 


Considerations (CON) 

Ability to generate ideas quickly 
Overall CTs (N=376) 

.13 


Performance/Potential Ratings 


CON Coded Score 

Bottom Half 

Top Half 

(low) 0-3 

(N= 98 ) 

60 $ 

40$ 

4-6 

(n=176) 

50$ 

50$ 

(high) 7-9 

(N=102 ) 

40 $ 

60 i 


TEST: 

MEASURES: 

GROUP: 

CORRELATION: 


Work Attitude - Social Deprivation (SOC DEP) 
Eagerness for work involving social deprivation 
Overall CTs (N=384) 

.11 


Performance/Potential Ratings 
SOC DEP Coded Score Bottom Half Top Half 


(eager for) 0-1 (N=48) 

2-4 (N= 23 D 

(reluctant 5-7 (N=102) 
towards ) 


56$ 

44$ 

53$ 

47$ 

4o$ 

60$ 


TEST: 

MEASURES: 

GROUP: 

CORRELATION: 


Contemporary Affairs Test (CAT) 
Knowledge of current events 
DDI CTs (N=82 ) 

.18 


CAT Coded Score 


Performance/Potential Ratings 
Bottom Half Top Half 


(low) 0-4 (N=23) 


6 l$ 


3 9$ 


5-6 (n=39) 56$ 


44$ 
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TEST: 

MEASURES: 

GROUP: 

CORRELATION: 


Strong Vocational Interest Inventory — CPA Partner Scale 
Interest pattern in comparison with CPA's 
EDI CTs (N=80) 

.29 


Perf ormance/Potential R atings 


CPA Partners 

Bottom Half 

Top Half 

Interests very dissimilar to (N=27) 

59$ 

4l$ 

Interests moderately similar to (N=35) 

57$ 

43$ 

Interests very similar to (N=l 8 ) 

39$ 

6 i$ 


TEST: 


MEASURES: 

GROUP: 

CORRELATION: 


Confident (CONFDT) 
Self-confidence 
DDS CTs (N= 86 ) 

.12 


Perform ance/ P otential Ratings 


CONFDT 

Coded 

. Score 

Bottom Half 

Top Half 

(low) 

0-3 

(N=17) 

65$ 

35$ 


4-6 

(n=50 ) 

56 $ 

44$ 

(high) 

7-9 

(N=19) 

26 $ 

74$ 


TEST: 

MEASURES: 


GROUP: 

CORRELATION: 


Strong Vocational Interest Inventory — Accountant Scale 
Interest pattern in comparison with accountants 
DDS CTs (N=86) 

.23 


P erformance/Potent ial R atin gs 


Accountants 

Bottom Half 

Top Half 

Interests very dissimilar to (N=l 8 ) 

6 l$ 

39$ 

Interests moderately similar to (N=37) 

59$ 

4l$ 

Interests very similar to (N=3l) 

35$ 

65 $ 


- 2 - 
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7. 


TEST: 
MEASURES : 
GROUP: 
CORRELATION: 


Considerations (CON) 

Ability to generate ideas quickly 
DDP CTs (N=209) 

.15 


Performance /Potential Ratings 


CON Coded Score 

Bottom Half 

Top Half 

(low) 0-3 

(N=58) 

5 5$ 

45$ 

4-6 

(N=95) 

48$ 

52$ 

(high) 7-9 

(n=56) 

37$ 

63$ 


8. TEST: 

MEASURES : 
GROUP: 
CORRELATION: 


Strong Vocational Interest Inventory — Psychologist Scale 
Interest pattern in comparison •with psychologists 
DDP CTs (N=205) 

.16 


9. 


Performance/Potential Ratings 


Psychologists 

Bottom Half 

Top Half 

Interests very dissimilar to (N=58) 

60 $ 

40$ 

Interests moderately similar to (N=73) 

45$ 

55$ 

Interests very similar to (N=74) 

42$ 

58$ 

MEASURE: College Quality 

GROUP: DDP CTs (N=195) 
CORRELATION: .17 




Performance/Potential Ratings 

College Quality 

Bottom Half 

Top Half 

(low) 36 -55.0 (N=45) 

64$ 

36$ 

(middle) 55*1-64.0 (N=103) 

49$ 

51$ 

(high) 64.1-75.0 (N=47) 

32$ 

68$ 

-3- 
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II 


REPRESENTATIVE SIGNIFICANT RELATIONSHIPS BETWEEN PATB TEST 
VARIABLES AND OVERALL EVALUATIONS IN CT TRAINING COURSES 


TEST: 

MEASURES: 

COURSE: 

CORRELATION: 


Contemporary Affairs Test (CAT) 
Knowledge of current events 
CT Communism (N=332) 

.29 


Overall Performance in Communism 
CAT Coded Score Proficient & below Strong & above 


(low) 

0-3 

(n=94) 

53 $ 

47$ 


4-6 

(N=200) 

39$ 

6l$ 

(high) 

7-9 

(N=38) 

11 $ 

89$ 


TEST: 

MEASURES: 

COURSE: 

CORRELATION: 


Interpretation of Data (IDY) 

Ability to interpret chart/graph data 
Intelligence Production (IPC) (N=90) 
.21 


Overall Performance in I.P.C. 


IDY Coded Score 

Proficient & below 

Strong & above 

(low) 0-3 (N=22) 


59$ 

41$ 

4-6 (N=45) 


64$ 

3 6$ 

(high) 7-9 (N=23) 


43$ 

57$ 

TEST: Work Attitudes - Analyze (Anal) 

MEASURES: Eagerness for job requiring analyzing people 

COURSE: Operations Course (O.C.) (N=232) 

CORRELATION: .22 


Overall Performance in O.C. 


Anal Coded Score 


Proficient & below 

Strong & above 

(eager for) 0-2 

(N=7l) 

42$ 

58$ 

3-^ 

(N=124) 

59$ 

41$ 

(reluctant 5-7 

(N=37) 

76$ 

24$ 

toward) 
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TEST: Strong Vocational Interest Inventory - CPA Partner Scale 
MEASURES: Interest pattern in comparison with CPA's 
COURSE: CT Orientation (N=257) 


CORRELATION: .18 

Overall 

Performance 

in CT Orientation 

CPA Partners 

Proficient & below 

Strong & above 

Interests very dissimilar to (N=10l) 


37$ 

63$ 

Interests moderately similar to (N=102) 

30$ 

70$ 

Interests very similar to (N=5l) 


1 1$ 

86$ 


TEST: 

MEASURES: 

COURSE: 

CORRELATION: 


Arithmetic Problems (AP) 

Arithmetic reasoning . 

Support Services Course for CTs (S.S.C.) (N=u3) 

.39 


Overall Performance in S.S.C. 


AP Coded Score 

Proficient & below 

Strong & above 

(low) 0-3 

(N=15) 

17$ 

53$ 

1-6 

(N=l9) 

23 $ 

77$ 

(high) 7-9 

(N=19) 

5$ 

95$ 


TEST: Strong Vocational Interest Inventory - Author/Journalist Scale 
MEASURES: Interest pattern in comparison with writers 
COURSE: Intelligence Techniques (ITC) (N=270) 

CORRELATION: .15 


Author/ J ourna li st s 


Overall Performance in ITC 
Proficient & below Proficient r ~ & above 


very dissimilar to (N=112) 

59$ 

11$ 

moderately similar to (N=109) 

56$ 

11$ 

very similar to (N=l9) 

37$ 

63 $ 
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Considerations (CON) 

Ability to generate ideas quickly 
Operations Course (O.C.) (N=228) 

.14 

Overall Performance in O.C, 

CON Coded Score Proficient & below Strong & above 
(low) 0-3 (N=56) 64$ 36 $ 

4-6 (h=ii4) 56 $ 44$ 

(high) 7-9 (N=58) 50 $ 50$ 


8 . TEST: Work Attitudes - Physical (Phys) 

MEASURES : Eagerness for work involving physical hazards 
COURSE: CT Communism (N=332) 

CORRELATION: -.18 

Overall Performance in CT Communism 
Phys Coded Score Proficient & below Strong & above 


(eager for) 0-2 

(N-132) 

51$ 

4 9 $ 

3-4 

(N=153) 

36$ 

64$ 

(reluctant 5-9 

(N=47) 

23$ 

77$ 


toward) 


7. TEST: 

MEASURES: 
COURSE: 
CORRELATION: 


9 . TEST: Reading Comprehension (RC-C) 

MEASURES: Reading comprehension 

COURSE: Intelligence Techniques (ITC) (N=278) 

CORRELATION: .24 

Overall Performance in ITC 

RC-C Coded Score Proficient & below Proficient ^ & above 


(low) 0-3 (N=5l) 69 $ 31$ 

4-6 (N=155) 5 !+$ 46$ 

(high) 7-9 (N=72) 43$ 57$ 


-3- 
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III 


REPRESENTATIVE SIGNIFICANT RELATIONSHIPS BETWEEN OVERALL 
EVALUATION IN TRAINING COURSES AND RATINGS OF 
JOB PERFORMANCE AND POTENTIAL 


COURSE: Intelligence Techniques (N=277) 

CRITERION: Rated overall job performance 
CORRELATION: ,24 

Overall Training Evaluation Overall Job Performance 

Proficient 4- & below Strong & above 


Proficient & below 

(N=l49) 

54$ 

46$ 

“f 

Proficient & above 

( 11=128) 

40$ 

6o$ 

COURSE: Operations Course, Phase II (N=ll6) 
CRITERION: Rated overall job potential 
CORRELATION: .22 


Overall Training Evaluation 

Overall Job 

Potential 



Average & below 

Above average 

Proficient & below 

(N=95) 

33$ 

67$ 

Strong & above 

(N=2l) 

l4$ 

86$ 


COURSE: Intelligence Production (N=90) 

CRITERION: Rated qualitative aspects of job performance 
CORRELATION: .28 

Overall Training Evaluation Job Performance — Qualitative 

” Proficient + & below Strong & above 

Proficient 4- & below (N-52) 52$ 48$ 

Strong- and above (N=38) 24$ 76$ 
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COURSE: 

CRITERION: 

CORRELATION: 


CT Communism (N=332 ) 

Rated overall jot potential 
.18 


Overall Training Evaluation 

Proficient & below (N=133) 
Strong & above (N=199) 


Overall Job Potential 


Average & below 

Above average 

4l$ 

59$ 

26 $ 

74$ 


COURSE: CT Orientation (N=258) 

CRITERION: Rated quantitative aspects of performance 


CORRELATION: .14 

Overall Training Evaluation 

Proficient & below (N=76) 
Strong (N=133) 

Outstanding (N=49) 


Job Performance -- Quantitative 
Proficient + & below Strong & above 

51$ 49$ 

47$ 53$ 

39$ 6 l$ 


COURSE: Intelligence Techniques (11=268) 
CRITERION: Rated senior level (GS-15) potential 
CORRELATION: .26 

fTVninlncr Evaluation Senior Level. 

Potential 


No 

Yes 

Proficient & below (N=l43) 

29$ 

71$ 

Proficient + & above (N=125) 

10 $ 

90 $ 
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COURSE: 

CRITERION; 

CORRELATION: 


Operations Course (N=23l) 

Rated qualitative aspects of performance 

.2 6 


Kirovan Training Evaluation Job Per f ormance ^Qualitativ e 

— Proficient & below Strong & above 


Proficient & below (N=13l) 

63$ 

37$ 

Strong & 

above (N=100) 

36$ 

64$ 

COURSE: 

Operations Course (N=23l) 



CRITERION: 

Rated overall job potential 



CORRELATION: 

.33 




Overall Training Evaluation 

Overall Job 

Potential 


Average & below 

Above average 

Proficient Sc below (N=13l) 


5196 

Strong & above (N=100) 

21 $ 

79 $ 


COURSE: CT Communism (N=333) 
CRITERION: Rated overall job performance 
CORRELATION: .l6 


Overall Training Evaluation 


Overall Job Performance 
Proficient + & below Strong & above 


Proficient & below (N=133) 


57 $ 


Strong & above (N=200) 


44$ 


*6$ 
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